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The MAILING DATE of this communication appears on the cover sheet with the correspondence address 
Period for Reply 

A SHORTENED STATUTORY PERIOD FOR REPLY IS SET TO EXPIRE 3 MONTH(S) FROM 
THE MAILING DATE OF THIS COMMUNICATION. 

- Extensions of time may be available under the provisions of 37 CFR 1 . 1 36(a). In no event, however, may a reply be timely filed 
after SIX (6) MONTHS from the mailing date of this communication. 

- If the period for reply specified above is less than thirty (30) days, a reply within the statutory minimum of thirty (30) days will be considered timely. 

- If NO period for reply is specified above, the maximum statutory period will apply and will expire SIX (6) MONTHS from the mailing date of this communication. 

- Failure to reply within the set or extended period for reply will, by statute, cause the application to become ABANDONED (35 U.S.C. § 1 33). 

- Any reply received by the Office later than three months after the mailing date of this communication, even if timely filed, may reduce any 
earned patent term adjustment. See 37 CFR 1.704(b). 

Status 

1 )^ Responsive to communication(s) filed on 20 December 1999 . 
2a)D This action is FINAL. 2b)03 This action is non-final. 

3) D Since this application is in condition for allowance except for formal matters, prosecution as to the merits is 

closed in accordance with the practice under Ex parte Quayle, 1935 CD, 1 1 , 453 O.G. 213. 
Disposition of Claims 

4) G3 Claim(s) 1-54 is/are pending in the application. \ 

4a) Of the above claim(s) is/are withdrawn from consideration. v N 

5) D Claim(s) is/are allowed. 

6) ^ Claim(s) 1-54 is/are rejected. 

7) D Claim(s) is/are objected to. \ 

8) D Claim(s) are subject to restriction and/or election requirement. \ 

Application Papers 

9) D The specification is objected to by the Examiner. 

10) D The drawing(s) filed on is/are: a)Q accepted or b)Q objected to by the Examiner. 

Applicant may not request that any objection to the drawing(s) be held in abeyance. See 37 CFR 1 .85(a). 

1 1) D The proposed drawing correction filed on is: a)D approved b)Q disapproved by the Examiner. 

If approved, corrected drawings are required in reply to this Office action. 

12) D The oath or declaration is objected to by the Examiner. 
Priority under 35 U.S.C. §§119 and 120 

1 3) ^ Acknowledgment is made of a claim for foreign priority under 35 U.S.C. § 1 1 9(a)-(d) or (f). 

a)^AII b)D Some*c)D None of: 

Certified copies of the priority documents have been received. 

2. D Certified copies of the priority documents have been received in Application No. . 

3. Q Copies of the certified copies of the priority documents have been received in this National Stage 

application from the International Bureau (PCT Rule 17.2(a)). 
* See the attached detailed Office action for a list of the certified copies not received. 

14) D Acknowledgment is made of a claim for domestic priority under 35 U.S.C. § 1 19(e) (to a provisional application). 

a) D The translation of the foreign language provisional application has been received. 

15) D Acknowledgment is made of a claim for domestic priority under 35 U.S.C. §§ 120 and/or 121. 
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1 ) ^ Notice of References Cited (PTO-892) 4) □ Interview Summary (PTO-41 3) Paper No(s). . 

2) □ Notice of DraftspersorVs Patent Drawing Review (PTO-948) 5) □ Notice of Informal Patent Application (PTO-152) 

3) ^ Information Disclosure Statement(s) (PTO-1449) Paper No(s) 4&6 . 6) □ Other: 
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DETAILED ACTION 



, This action is responsive to _icati„ns: original application filed 12/20/1999; .DS 

filed 01/28/2000 and 12/26/2000. 

currently pending in this application. Claims 1 and 27 are independent 



2. Claims 1-54 are 
claims. 



Specification 



3. The title of the invention is no. descriptive. A new title is required that is clearly 
indicative of the invention to which the claims are directed. Correction is required. 

4. The abstract of the disclosure is objected to because it exceeds the limit of 150 words. 
Correction is required. See MPEP § 608.01(b). 

5 Thedisclosureisobjectedtobecauseitcontamsanembeddedhyperlinkand/oromer 
form of browser-executable code for example a, page 35, tine 16. Apphcant is required to delete 
the embedded hyperlink and/or other form of browser-executable code. See MPEP § 608.01. 
6 . Claim 4 is objected to because of the following informalities: -the sore" (claim 4, line 6) 
should read 'the score". Appropriate correction is required. 

Claim Rejections - 35 (JSC § 112 



The 



following is a quotation of the second paragraph of 35 U.S.C. 1 12: 
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Ciaims 1-54 are rejected under 35 U.S.C. 1 12, second paragraph, as being indefimte for 
faiiing ,o particular* point on, and distinctly ciaim the subject matter which applicant regards as 

the invention. 

Claims 1-54 recite the limitations: 

. "the context of the media content" (claim 1, line 7) 

- "the media content" (claim 1, line 10) 

- "the media segments" (claim 1, line 15) 

- "the context of the media content" (claim 27, line 16) 
. "the media content" (claim 27, line 19) 

. "the media segments" (claim 27, lines 23-24) 

There are insufficient antecedent basis for these limitations in the claims. 

Dependent claims 2-26 and 28-54 are rejected for fully incorporating the deficiencies of 

their base claims. 

Claim Rejections ■ 35 USC § 103 



■ • w;™nf^USC 103(a) which forms the basis for all 
8. The following is a quotation ot 35 U.i>.^. iu:>w 

obviousness rejections set forth in this Office action: 

forth in section 1 02 of this Wle, ^Mte^W^^ have been obvious at the t.me the 
the prior art are such that the " a £ff 5?irt to which said subject matter perta.ns. 

^eS^ 
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Claims 1-54 are rejected under 35 U.S.C. 103(a) as being unpatentable over French et al. 
(U.S. 6266,053 - filed 04/1998) in view of Ozsoyoglu et al. "Automating the Assembly of 
Presentation from Multimedia Databases", (Public Release - 1996). 

As to independent claim 27, French teaches a data processing method (the processing of 
data; col.8, lines 27-38) comprising input means for inputting context description data described 
inahierarchical structure, wherein the Merarchical st^ ^ 

nodes in a graph; col.2, lines 60-67/ hierarchical data structures; col.7, line 65-col.8, lineS) 
comprises: 

- the highest hierarchical layer (Nodes with no ancestors are know as root node 43; 
col.8, lines 1-2 & Fig- 2) in which time-varying media content and the context of the media 
content are formed into a single element representing media content (The root node specifies an 
initia, temporal content with a time scale and time interval associated ... media production; 
col.4, lines 25-321 the highest level m>e « the system is Temporal, which relates to the handling 
of scene time within the hierarchy; coil 2, lines 54-57); 

- the lowest hierarchical layer (nodes without children are called leaf nodes; col. 7, line 
65- col.8, line 3) in which an element represents a media segment formed hy dividing the media 
content and is assigned, as an attribute, time information relating to a corresponding media 
segment and a scored— of a scene ...data representative of the media elements; col.3, 
lines 58-64/Nodes in the graph 40 are operators 50 on multimedia data, or containers 52 for 
references to such multimedia stored elsewhere in the system 10; col.8, lines 14-62); 

. other hierarchical layers include elements which are directly or indirectly associated 
with at least one of the media segments and which represent scenes or a set of scenes (nodes 
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**** have ancestors and children are referred to herein as branch of intermediate nodes; col.7, 
lines 53-67). 

French, however, does not explicitly teach "selection means for selecting at least one 

segment from the media content." 

Ozsoyoglu teaches selection means for selecting at least one segment from the media 
content (choose a set of multimedia segments for presentation by simply pointing and clicking; 
page 593, the right column, the third paragraph). 

It would have been obvious to a person of ordinary skill in the art at the time the 
invention was made to combine the teachings of Ozsoyoglu with French because it would have 
provided the enhanced capability for selecting a multimedia segment from a composition 

hierarchy for presentation. 

As to dependent claim 28, French does not explicitly teach "extraction means for 
extracting only data corresponding to the segment selected by the selection means, from the 
media content." 

Ozsoyoglu teaches extraction means for extracting only data corresponding to the 
segment selected by the selection means, from the media content (page 593, the right column, 

the third paragraph). 

It would have been obvious to a person of ordinary skill in the art at the time the 
invention was made to combine the teachings of Ozsoyoglu with French because it would have 
provided the enhanced capability for selecting a multimedia segment from a composition 
hierarchy for presentation. 
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As to dependent claim 29, French does not explicitly teach "playback means for playing 
back only data corresponding to the segment selected by the selection means, from the media 
content." 

Ozsoyoglu teaches playback means for playing back only data corresponding to the 
segment selected by the selection means, from the media content (page 594, the right column, 
the second and third paragraphs). 

It would have been obvious to a person of ordinary skill in the art at the time the 
invention was made to combine the teachings of Ozsoyoglu with French because it would have 
provided the enhanced capability for selecting a multimedia segment from a composition 
hierarchy for presentation. 

As to dependent claim 30, French teaches the score represents a contextual importance 
of media content (colli, lines 8-37). 

As to dependent claim 31, French teaches the score represents the degree of contextual 
importance of a scene of interest from the viewpoint of a keyword (Figs. 12- 13). 

French, however, does not teach "the selection means selects a scene in which the score 
is used from at least one viewpoint." 

Ozsoyoglu teaches the selection means selects a scene in which the score is used from at 
least one viewpoint (page 593, the right column, the third and fourth paragraphs). 

It would have been obvious to a person of ordinary skill in the art at the time the 
invention was made to combine the teachings of Ozsoyoglu with French because it would have 
provided the enhanced capability for selecting a multimedia segment from a composition 
hierarchy for presentation. 



Application/Control Number: 09/467,321 
Art Unit: 2176 



Page 7 



As to dependent claim 32, French teaches the media content corresponds to video data 
or audio data (col 3, lines 46-64). 

As to dependent claim 33, French teaches the media content corresponds to data 
comprising video data and audio data, which are mutually synchronized (col A, lines 33-63). 

As to dependent claim 34, French teaches the context description data describe the 
configuration of video data or audio data (Figs. 12-13). 

As to dependent claim 35, French teaches the context description data describe the 
configuration of each of video data sets and audio data sets (Figs. 12-13). 

As to dependent claim 36, French does not explicitly teach "the selection means selects 
a scene by reference to context description data pertaining to video data or audio data." 

Ozsoyoglu teaches the selection means selects a scene by reference to context description 
data pertaining to video data or audio data (page 593, the right column, the third and fourth 
paragraphs). 

It would have been obvious to a person of ordinary skill in the art at the time the 
invention was made to combine the teachings of Ozsoyoglu with French because it would have 
provided the enhanced capability for selecting a multimedia segment from a composition 
hierarchy for presentation. 

As to dependent claim 37, French does not explicitly teach "the selection means 
comprises video selection means for selecting a scene of video data by reference to context 
description data of video data or audio selection means for selecting a scene of audio data by 
reference to context description data of audio data." 
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Ozsoyoglu teaches the selection means comprises video selection means for selecting a 
scene of video data by reference to context description data of video data or audio selection 
means for selecting a scene of audio data by reference to context description data of audio data 
(page 593, the right column, the third and fourth paragraphs). 

It would have been obvious to a person of ordinary skill in the art at the time the 
invention was made to combine the teachings of Ozsoyoglu with French because it would have 
provided the enhanced capability for selecting a multimedia segment from a composition 
hierarchy for presentation. 

As to dependent claim 38, French does not explicitly teach "the selection means 
comprises video selection means for selecting a scene of video data by reference to context 
description data of video data, and audio selection means for selecting-a scene of audio data by 
reference to context description data of audio data." 

Ozsoyoglu teaches the selection means comprises video selection means for selecting a 
scene of video data by reference to context description data of video data, and audio selection 
means for selecting-a scene of audio data by reference to context description data of audio data 
(page 593, the right column, the third and fourth paragraphs). 

It would have been obvious to a person of ordinary skill in the art at the time the 
invention was made to combine the teachings of Ozsoyoglu with French because it would have 
provided the enhanced capability for selecting a multimedia segment from a composition 
hierarchy for presentation. 

As to dependent claim 39, French teaches the data to be extracted by the extraction data 
correspond to video data or audio data (coil 3, lines 4-55). 
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As to dependent claim 40, French teaches the data to be extracted by the extraction data 
correspond to data comprising video data and audio data, which are mutually synchronized 
(colli, lines 4-55). 

As to dependent claim 41, French teaches media content comprises a plurality of 
different media data sets within a single period of time; and the data processing device further 
comprises: determination means which receives structure description data having a data 
configuration of the media content described therein and determines which one of the media data 
sets is to be taken as an object of selection, on the basis of determination conditions to be used 
for determining data as an object of selection; and the selection means selects data from only the 
data sets, which have been determined as objects of selection by the determination means, by 
reference to the structure description data (col 12, lines 18-57). 

As to dependent claim 42, French teaches determination means which receives structure 
description data having a data configuration of the media content described therein and 
determines whether only video data, only audio data, or both video data and audio data are taken 
as an object of selection, on the basis of determination conditions to be used for determining data 
as an object of selection; and wherein the selection means selects data from only the data sets 
determined as objects of selection by the determination means, by reference to the structure 
description data (coll2 } lines 18-63). 

As to dependent claim 43, French teaches media content comprises a plurality of 
different media data sets within a single period of time; the determination means receives 
structure description data having a data configuration of the media content described therein and 
determines which one of the video data sets and/or audio data sets is to be taken as an object of 





Application/Control Number: 09/467,321 
Art Unit: 2176 



Page 10 



selection; and the selection means selects data from only the data sets determined as objects of 
selection by the determination means, by reference to the structure description data (col 14, lines 



As to dependent claim 44, French teaches representative data pertaining to a 
corresponding media segment are added, as an attribute, to individual elements of context 
description data in the lowest hierarchical layer; and the selection means selects the entire data 
pertaining to the media segment and/or representative data pertaining to a corresponding media 
segment (col. 14, lines 5-40). 

As to dependent claim 45, French teaches the entire data pertaining to the media 
segment correspond to media data, and the media content comprises a plurality of different 
media data sets within a single period of time; and the data processing device further comprises 
determination means which receives structure description data having a data configuration of the 
media content described therein and determines which one of the media data sets and/or 
representative data sets is to be taken as an object of selection; and the selection means selects 
data from only the data sets determined as objects of selection by the determination means, by 
reference to the structure description data (colli, lines 16-43). 

As to dependent claim 46, French teaches determination means which receives structure 
description data having a data configuration of the media content described therein and 
determines whether only the entire data, pertaining to the media segment, only the representative 
data pertaining to the media segment, or both the entire data and the representative data 
pertaining to a corresponding media segment are taken as objects of selection, on the basis of 
determination conditions to be used for determining data as an object of selection; and wherein 



4-55). 
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the selection means selects data from only the data sets determined as objects of selection by the 
determination means, by reference to the structure description data (col 13, lines 4-55), 

As to dependent claim 47, French teaches the determination conditions comprise at least 
one of the capability of a receiving terminal, the traffic volume of a delivery line, a user request, 
and a user's taste, or a combination thereof (col 13, lines 4-55). 

As to dependent claim 48, French teaches comprising formation means for forming a 
stream of media content from the data extracted by the extraction means (col 13, lines 10-26). 

As to dependent claim 49, French teaches comprising delivery means for delivering the 
stream formed by the formation means over a line (col 12, lines 5-31). 

As to dependent claim 50, French teaches recording means for recording the stream 
formed by the formation means on a data recording medium (col 13, lines 4-55). 

As to dependent claim 51, French teaches comprising data recording medium 
management means which re-organizes the media content that has already been stored and/or 
media content to be newly stored, according to the available disk space of the data recording 
medium (col. 14, lines 5-52). 

As to dependent claim 52, French teaches stored content management means for re- 
organizing the media content stored in the data recording medium according to the period of 
storage of the media content (col 14, lines 5-52). 

As to dependent claim 53, French teaches a computer-readable recording medium on 
which the data processing method is recorded in the form of a program to be performed by a 
computer (col. 7, lines 14-41). 
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As to dependent claim 54, French teaches a program for causing a computer to perform 
the data processing method (col 7, lines 14-41). 

Independent claim 1 is directed to a data processing device for performing the method 
of independent claim 27, and is similarly rejected under the same rationale. 

Dependent claims 2-26 include the same limitations as in claims 28-52, and are similarly 
rejected under the same rationale. 

Conclusion 



9. The prior art made of record and not relied upon is considered pertinent to applicant's 
disclosure. 

Moriyama et al. U.S Patent No. 5,889,746 issue dated: Mar. 30, 1999 

Mauldin et al. U.S Patent No. 5,664,227 issue dated: Sep. 2, 1997 

Marcus U.S Patent No. 6,032,156 issue dated: Feb. 29, 2000 

Crinon U.S Patent No. 6,331,859 issue dated: Dec.18,2001 

10. Any inquiry concerning this communication or earlier communications from the 
examiner should be directed to Maikhanh Nguyen whose telephone number is (703) 306-0092. 
The examiner can normally be reached on Monday - Friday from 9:00am - 5:30 pm. 

If attempts to reach the examiner by telephone are unsuccessful, the examiner's 
supervisor, Joseph H. Feild can be reached on (703) 305-9792. The fax phone numbers for the 
organization where this application or proceeding is assigned are (703) 308-5403 for regular 
communications and (703) 308-5403 for After Final communications. 
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Any inquiry of a general nature or relating to the status of this application or proceeding 
should be directed to the receptionist whose telephone number is (703) 305-9600. 
Contact Information: 

Any response to this action should be mailed to: 

Commissioner for Patents 
PO Box 1450 

Alexandria, VA 22313-1450 
Or fax to: 

AFTER-FINAL faxes must be signed and sent to (703) 746-7238. 
OFFICIAL faxes must be signed and sent to (703) 746-7239. 
NON OFFICIAL faxes should be sent to (703) 746-7240. 

All OFFICIAL faxes will be handled and entered by the docketing personnel. The date 
of entry will correspond to the actual FAX reception date unless that date is a Saturday, 
Sunday, or a Federal Holiday within the District of Columbia, in which case the official 
date of receipt will be the next business day. The application file will be promptly 
forwarded to the Examiner unless the application file must be sent to another area of the 
Office, e.g., Finance Division for fee charging, etc. 

Hand-delivered responses should be brought to Crystal Park II, 2121 Crystal Drive, 
Arlington, VA., Sixth Floor (Receptionist). All hand-delivered responses will be handled 
and entered by the docketing personnel. Please do not hand deliver responses directly to 
the Examiner. 



Maikhanh Nguyen 
September 3, 2003 




SANJiy SHAH 
PRIMARY EXAMINER 



